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ABSTRACT 

A two-stage project generated and tested a 
problem-solving linkage model of dissemination and utilization (DU) 
processes. The first phase involved the analysis of the DU activities 
of four Federal agency units in order to produce the model. The 
overall DO process was conceptualized as a dialogue between users 
with infor»9ation needs and suppliers who provided the required 
information. The basic model created consisted of six function sets; 
1) user solf-servicing; 2) need processing; 3) solution building; 4) 
solution processing; 5) microsystem building; and 6) macrosystem 
building. Phase II of the project involved the application of the 
model to an applied research and development organization to 
determine if it would; 1) promote understanding of the perceptions of 
the DO process held by members of the organizaticn, and 2) help 
predict the internal behavior of and applied contributions made by 
the organization. The model did accurately describe the activities of 
the organization and helped the organization's researchers conduct 
attitudinal self-assessments. It was concluded that the model 
assisted the researchers to see their own activities in modol terms 
and it was recommended that additional research study the model's 
utility to user groups. (LB) 
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DEVELOPING AND TESTING A LINKAGE MODEL 
OF DISSEMINATION AND UTILIZATION 



INTRODUCTIO N 

Research on the utilization of scientific knowledge can only be as 
good as the concepts, models, and theories on whfch it fs based. We have 
had concepts for nian^ years--ext racted from the operations of real -life 
knowledge diffusers and users, and adapted from older, more general social 
science disciplines. On the other hand, none of us would claim that we 
have anything close to a theory of how research knowledge gets generated, 
disseminated, and put to use. We are somewhere in the middle, at the model 
building stage. The trick is to build models of dissemination and utiliiia- 
tion C^D^U") which are sufficiently gene ra 1 1 zab 1 e so that they can be used 
for more than description of the situations from which they were derived. 
That is, after we build a model descriptive of one DSU situation, we need 
to see if the model can relate to and predict behaviors of other systems. 

In this paper we will descrtbe the generation and testing of a "'problem- 
solving linkage model'* of OSU processes. Two separate studies are Involved. 
The model was created to describe the O^U activities of four Federal agency 
units. It was then applied to help us understand the role of perceptions 
of the DSU process on the part of scientists in another government agency, 
and how these perceptions help us to predict their D&U environment and 
personal scientific and applied contributions. 

DEVELOPMENT OF THE HODEL'-THE "FOUR AGENCY D&U STUDY'^ 

Late in 1971 > Havelock and LIngv/ood (1973) began a project, sponsored 
by the Manpower Administration, DOL, with three objectives: (l) to describe 
the activities of four Federal agency OSU units,' (2) to study confvnun i cat i on 
patterns within the networks of policy/research/application surrounding each 
unit, and (3) to create an opportunity for inter-agency comparison by the 
staffs involved. 

The major task of the project was one of summarizing open-ended inter- 
views with agency staffs, both inside and around the D&U units, which provided 
material descriptive of D&U philosophy and operations. Collecting the infor- 



matlon was simple enough. What proved more difficult was developing a co- 
herent framework which would allow complete description, Integration, and 
comparison of the four agenclesi function by function. It became Immediately 
apparent that the diversity of Intra-agency, let alone inter-agency, responses 
was so great that none of the existing models of DSU could be used. For 
example, while a linear Research-Development-Otssemlnation model might handle 
the comments of one respondent, the next person {or the next agency) n^lght 
be working extensfvely wfth user populations fn a problem-solving mode, while 
the third might have based his thinking on diffusion theory, and so on. 

A more macroscopic approach solved the problem for us. If we stepped 
back from the day-to-day activities, job roles, and attitudes of OSU staff, 
wc could conceptualize the whole research production and utilization process 
as a problem-solving dialogue between an Individual, group, or system with e 
need for research information, and individuals, groups, or systems who create 
or otherwise prov I de the needed knowledge. Dialogue implies two-way communi- 
cation, or more important yet, conditional two-way communication. That Is, 
in dialogue, person A*s response to B is conditioned by what B has just said, 
and so on. This approach gave us a model which Is level or situation free. 
It could be used In all four agencies and could cover the OSU activities of 
one person, or those of a whole system. 

The basic model we^ developed Is shown In Fl gure 1 . Let us work through 
the processes contained here from right to left. We begin with the user of 
research knowledge to stress our concern with application, rather than just 
dissemination of knowledge. If we start with the user we are concerned with 
his abilities to solve his own problems , become aware of needs he cannot meet 
alone, and express these needs to potential outside solution-providers. On 
the other hand, the user must have the capacity to seek solutions provided 
by outsiders, and adapt and integrate these to his situation so that they may 
be applied to alleviate needs. At this level of generality, "needs'* may be 
for anything, not just for research. In fact, most of us or our systems go 
through great amounts of help-seeklng/help-using without ever generating 
need statements which require the use of existing research, or the creation 
of new knowledge, nevertheless, if there Is a channel open, many important 
needs which cannot be answered locally do get transmitted to remote collections 
of research knowledge, and if these fail, to centers of research-creation 
export i se» 
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We said 'Mf there Is a channel open," bringing us to they first link 
between user and solution-source. This we call the need processing function ^ 
The steps In need-processing (as In solution delivery) become. more complex 
as we move from dyads of people to interacting systems, but the generic pro- 
cesses remain the same. Beginning with the user's ability to generate and 
articulate a need, we move to transmission and re-def intt ion processes linl<- 
Ing user and solution sources, tn the one-to-one case this may be as simple 
as two people agreeing on what the needs of one of them are, in terms under- 
standable to both. In complex systems, there probably will be separate 
processes for need assessment, analysis, and channeling of needs to appro- 
priate solution sources: policy makers, program administrators, or R&D. Since 
we are concerned with research knowledge, we will talk about only these needs 
from here on, other than to note that DSU units of agencies do get into the 
need sorting process, and require ways to send selected needs to policy or 
program un I ts . 

Sol ut i on bu i 1 d i ng functions are on the left of the mcdel. Obviously, 
the steps Involved again depend on whether the research need can be met from 
existing knowledge, or if new research or development is required. If the 
knowledge exists, then there is a retrieval step which may be as simple as 
one person *s memory, or as complex as search, retrieval, and synthesis of 
many diverse pieces of research. If the knowledge is found not to exist, 
then DSU units must become somewhat involved in the research creation process. 
Here the model becomes somewhat vague, since we did not have units which were 
sponsoring research (other than that on the RS0-D6U process--which is in it- 
self a part of this set of functions). In general, however, D6U personnel 
must interact with the research and development communities to influence 
them to be more relevant to needs, and to become more active in encouraging 
utilization of their results. 

Once solutions from R&D exist, they still must be taken back to che poten 
tial users. Historically, this has been a high-activity area in D&U at the 
Federal level. Many D&U systems started with an emphasis on dissemination 
of existing RSD rather than (as does our model) with real user needs. There 
are three distinct types of activity in solut ion processing . First, R&D 
knowledge must be transformed, in stylo and (sometimes) content so that it is 



unde^-standabl e by the user to whom It !s targetted. Second, it must be 
transmitted on appropriate channels so that It Indeed reaches the user. 
Third, the user must be helped to put the knowledge to use by translating 
It to his situatton--thus completing the cycle back to our starting point. 
All three stens are necessary, though again they differ depending on the 
size of the systems Involved. Historically, hov/ever, we have seen many 
examples of systems which began only with transmission activities, and then 
belatedly discovered the need for transformation. 

The four processes we have described so far cover most of the '^maximal*' 
or "tdeaP^ activities In Dt;U. We have added two more, however. The first, 
which we call microsystem building , was constructed to focus our attention 
on Interpersonal research utilization. While the model could be applied to 
these separately, we wanted a way to present both the agency-system level 
activities and the person-to-person activities at one time. Perhaps, as 
well, there are some qualitative differences in microsystems which result 
from their face-to-face, real time characteristics which might be lost if 
we simply separated them and applied the four processes of the model. In 
the four agencies, we studied, microsystem activities included such things 
as direct interchange between researchers and users, R6D in which the user 
collaborated actively, and integrated programs of RSD and 06U. Experiences 
gained in these actlvit:fes should, in the Ideal system, be tapped to Improve 
operations in the other four model areas, as well. 

The final step in the mode! Is the overview and monitoring function we 
have called macrosystem building . Regardless of the level or complexity of 
the DSU problem-solving process, somcione or something must be set up to 
evaluate, compare, discover missing elements, and create activities to fill 
gaps. This becomes particularly important if we are talking about inter- 
organizational DSU activities, for example at the Federal level. An inipor- 
tant part of this Is learning from other similar systems. Finally, our con- 
cept of macrosystem building includes the tasks of promoting interchange, and 
creating an awareness on the part of persons involved that they are part of a 
total RSD-DeU system. While these steps are complex and difficult at the 
organization level, their analogy at the interpersonal level Is the monitor- 
ing of process or interaction. 

This, then, comprises the model we developed to categorize our learn- 
ings about the four D6U units studied. tt would take us more time than is 
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available to describe how we coded our verbal data Into the model, verified 
It with respondents, and presented It In side-by-slde agency comparisons. 
We have, however, created ^'capsule sqmmarles"" of the activities of the four 
D6U units for each of the steps In the model, and these are Included below. 
Before we can go to these we need a brief introduction to the four units bo 
that the summaries can be read in context, considering the unites location and 
mission* 



THE FOUR DSU UNITS ' 

(1) Divf^ ion of RSD Utilization, Manpo wer Administrat io n, POL 

A. Purpose ; Based on DOL research designed to understand factors 
interfering v/ith full, productive employment, and projects 
designed to improve employment, the DRDU was created from two 
earlier units fn 1970. It has strlved to make RSD knowledge 
available both to agency policy and program staff, and to 
gather innovative techniques and service delivery methods. 

B. Staff S Support : As of November, 1971 > DRDU consisted of 
seven professional and three clerical staff persons. DRDU Is 
one of five divisions of the Office of Research and Development. 
DRDU works from the total ReD budget of ORD, and was administer- 
ing $1.75 million in contracts, out of the total $23 million 
ORD budget, at the time of our study. 

C. Act I vl ties : DRDU staff were active In RSD contract and grant 
work directly, and through "buddy system" links to other ORD 
research project officers. About half of the staff's time was 
devoted to these linkages, through which they help define D6U 
strategy and appropriate user groups for project outputs . 
Staff were also active in summarization of results, distribu- 
tion inside and outside of their agency, and RSD and evaluation 
of DSU itsel f . 

(2) Research Utilization Branch, Social and Rehabilitation Service, DHEW 

A. Purpose : RUB has come, since its creation in I967i to be a focus 
for DeU activities in the area of vocational rehabilitation, and 
recently, in other SRS program areas such as welfare research 
and aging. RUB's major goals include: improvement of agency R6D 
information activities, impact on the conduct of research to 
insure the usefulness of outputs, to link R6D to practice set- 
tings, and to create new knowledge about DsU v/hile planning an 
overall research utilization system for the agency* 

8. Staff ^ Suppo rt: During our interviewing, RUB was made up of 
four profess f onal staff, though the unit has expanded somewhat 
during its change to Division status. RUB works from RSD money 
pooled in the Office of Research and Demonstrations, which now 
coordinates all SRS research. 
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C. Act i vi t tes ; Responsibilities of RUB have expanded over time 
to include utilization efforts^ telecommunications, and 
guidance for development of an SRS-wIde Information system, ^ 
Staff activities can be categorized In three broad areas: 
policy formulation, planning and development of Intramural 
and contracted RSD-DSU efforts, and contract management for 
D6U projects. As we will see In the model-step comparisons 
below, the staff also have been directly involved In repack- 
aging and dissemination. 

(3) Mental Health Services Development Branch, NIMH, PHEW 

A« Purpose : This unit has three objectives: evaluating problems 
and needs in mental health service delivery, solution develop- 
ment from existing or research knowledge, and fostering D&U 
for these solutions* MH Services is also an amalgamated unit 
(as are the MA and SRS units), having been formed from earlier 
applied research and mental health service-support programs. 
The dual history survives in staff expertise and activities. 

B. Staff & Support ; At the time of interviewing, the branch con- 
sisted of about !8 professionals with expertise In a variety 
of areas (e.g., psychiatry, psychology, social work). The 
branch was operating with a research budget of about $10 
million, plus additional funds for publications, conferences, 
and direct client consultation (e.g., with community mental 
health centers). 

C. Act I vi t ies : The work of the branch fits in three broad areas: 
consulting In the field with grant applicants, mental health 
centers, etc.; serving as a base of information and expertise 
within NiMH through internal reports, task force assignments, 
etc.; project monitoring. The unit Is organized by program 
areas, with a staff member assigned to each according to skills 
(e*g», children's mental health); the staff member coordinates 
all activities In that substantive area. 

(4) National Center for Educational Communication, Office of Education, PHEW 

A. Purpose : NCEC had (^'had** since it is now a part of NIE) the 
mission of: fostering PSU of validated educational innovations, 
strengthening state and local DSU capabilities, increasing 
agency and public access to educational RSP knowledge, and sup- 
porting RSP on the PeU process Itself. 

B. Staff S f^upport : At the time of interviewing NCEC was planning 
for a FY 1973 funding base of almost $15 million, with about 

$9 million allocated for the educational extension piogram, and 
the rest for communication support activities. There were 28 
professional staff in NCEC, with backgrounds in i nforma;,t i on 
services, teaching, and school administration. 
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C. Activities ; NCEC staff activities vary according to tne 
particular unit within which members worked. Staff mrsm- 
bers in the Extension Support Branch sponsored much of 
the ReD in the area of DeU , and also evaluations of NCEC 
itself. Communication Support staff were divided among 
the Educational Resource Information Centers (ERIC)» and 
the Educat iof)^} Reference Center, which provided direct 
Information services such as computer searches for OE and ^ 
DHEW staff. 

These brief summaries are not intended to cover the broad range of 
work In the four units, but will help us to interpret their activities 
as we summarize them according to the steps or ''function sets" of the 
DSU model. We will approach each function set In three ways: first, we 
will list the ''maximal" set of activities which might be included within 
that functional step by a fully-functioning D6U organization. We must 
note that we do not mean to imply that the particular units we have chosen 
for study should be Involved in all of the maximal activities. Rather, 
these are tasks which probably need to be done somewhere i n the fully- 
functioning DSU system. 

Second, we will present capsule comparisons of what we heard in our 
interviewing in each unit, things we could code as activities covered in 
the particular step of the model. These capsules are themselves vastly 
shortened versions of comparisons in the study report (Havelock and Lingwood, 
1973) > and we refer the interested reader to this source for more complete 
list ings of act IvI t i es . 

Finally, we will offer a briefer-still comparison of the four units, 
trying to extract overall trends and more abstract statements about O&U. 
We have tried to be as non-evaluative as possible in these comparison state- 
ments. 

A. SUMMARY COMPARISONS OF THE FOUR D6U UNITS 

Function Set #1. User Self-Servicing 

MAXIMAL: An effective and progressive user self-servicing subsystem 
has a good localized problem-solving capacity, maintains a 
continuing av;areness of its needs, present and future, 
knows hov/ to express its needs to potential resource 
persons and groups, looks outward and inward for innova- 
tions, and is able to adapt new ideas. Maximal DsU activi- 
ties in this area would focus on helping the user help him- 
self by providing training or support on any of the above 
sub-processes. 
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HA : Very little process helping Is provided by the Division of 

RSD Utilization in the form of training or techniques for 
receiving or using knowledge; iiowevor> several Job Coaching 
manuals that have been developed or sponsored potentially 
serve th i s f unct ion. 

SRS : Although the Research Utilization Branch does not have sole 

• ^rejp<4asjbi 1 1 ty or resources and capacity to fulfill user 
s/i f-5er>kdng functions, they do attempt to up to such 

/fforts of o^^er units in SRS. For example, RUB has played 
p major role IrNtfaining efforts among the Research Utiliza- 
tion Laboratories and the Research Utilization Specialists, 
Much of this training has been oriented toward building 
human relations and prob 1 em- sol v i ng skills and is user- 
centered in emphasis. 



U t hH ; In the Mental Health Services Development Branch » user self- 

servicing is promoted by staff consultation to community 
mental health centers, ^^how to*' manuals focusing on problem- 
solving procedures, and projects concerned with techniques 
of training for planned change. 

OE : Although developing user self-servicing is not central to 

the mission of the National Center For Educational Corrvnun i ca- 
tion, there is an emphasis on training local intermediaries 
as special process helpers; the extension agents are supposed 
f to serve as one method to give users technical and program- 

matic assistance in loca 1 ly- i n i 1 1 a ted problem-solving activi- 
ties. 



COMPARI SON : Across the four agencies, access to clients varies as a 

result of historical relationships with clients, mandated 
posture to them, size of the units, and level and extent of 
activity of the client groups themselves. User self-servicing 
activities range from NtMH's consultation work with clients 
to MA's past mission-dictated separation from 1 i ne act 1 vi 1 1 es 
at the state and local level. Relative size of client groups 
to available D6U unit staff also appears to be an important 
factor. 



Function Set §2: Need Process Ing 

MAXi MAL ; Maximal 0&U functions in the area of need processing would 
Include various activities required to communicate user 
needs to resource persons and systems. Transformation 
activities such as need arousal, need sensing, need 
definition, and needs assessment are necessary for trans- 
mission of needs to policy makers and to the RsO community. 
Additional specialized t rans formot i ons Include the trans- 
lation of need priorities into research and development 
programs with dollar authorizations and into problems 
amenable to RsD. 
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MA: Staff of the Division of RSD UtHlzatlon feel tliat they do 

not have primary responsibility for need processing or for 
determining the direction of the RlD program. ORD, as a 
whole, is responsible for need processing and the planning 
of future R6D programs; the Division generally applies Its 
knowledge of user needs In relating users to products of 
the R6D program. 

SRS : The Research Utilization Branch is involved rn the Operational 

Planning System of SRS which allows for annual updating of 
objectives and design of research proposals to meet these 
objectives. Although not the direct responsibility of RUO, 
needs are transmitted to various policy makers by means of 
the yearly RSD Strategy; other means of transmission include 
the R&D Brief Series , RU Specialists, and the "Bidder*s 
Conference 



N I MH ; Need processing activities in the Mental J^ea 1 th Services 

Development Branch appear co be heavily influenced by re- 
searchers and by staff members working in consultation both 
with researchers and with mental health personnel. Although 
most need processing activities are carried out on an In- 
formal basis, more formal efforts include peer review panels 
and Branch-!.ponsored needs assessment projects. 

OE ; In genera!, need processing activities in the National n 

Center for Educational Communication seem to be stronger^ 
in the area of need transformation than in the area of need 
transmission. Although user need input Is stressed in NCEC 
programs and projects, priorities are written into legislation 
and come down from the highest level. 



COMPARI SON : In general, it appears that the four DSU units are only 

peripherally active in need sensing which has the objective 
of producing new R&D. The units do not serve as need moni- 
tors for their agencies' research programs; policy makers or 
researchers themselves tend to assume this responsibility. 
There is more need sensing activity ir> the units tor their 
own clients, and for the research the units produce. NIMH's 
closer link to its smaller number of clients results in 
the greatest activity as need-sensor. Two of the units 
(NIMH and OE) have undertaken formal need sensing studies 
with clients in the field; MA*s and SRS's activities are 
formalized in the agency planning process, but not vis a 
vis field clients. 
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Function Set #3* Sol ut ion Bui Iding 

MAXIMAL : Although most solution building functions lie outside of 
the domain of 0&U| three processes can be identified as 
maximal D5U activities In this area: influencing R&D to 
be more relevant to society; Influencing R&O to be more 
disseminable and utillzable; and research on the process 
of ut I 1 Izatlon 1 tsel f . 

Staff members of the Division of R&D Utilization are able 
to apply considerable pressure toward relevance and utiliza- 
tion of certain applied research and demonstration projects 
through involvement In the "buddy system^' and also by Inter- 
vention in final report writing for projects, SevereJ^ 
efforts have been mr3de to conduct R&D on the D&U pro<i4ss, 
although many of these efforts have been more conc^; rned 
with the improvement of D&U practices than with the D&U 
process itself. 

Guidelines developed by the Research Utilization Branch for 
final report v/riting and "instructions" for grantees to 
include utilization requirements In their research proposcHs 
have influenced R&D output to be more usable and relevant, 
RUB has sponsored an evaluation of the RU Specialists plus 
other projects designed to Iniprove the process of dissemina- 
t ion and ut i 1 i zat ion . 

NIMH: Indicative of the pressure tov;ard relevancy and utility of 

R&D in the Mental Health Services Development Branch Is 
the list of criteria used by review panels In evaluating 
research proposals; this list, developed In a Branch- 
sponsored project, includes items on project relevance and 
utilization, Although there has been some difficulty in 
obtaining funds for research on the D&U process, several 
projects have been sponsored that have had effects on 
Branch operation. The Branch has no influence on research 
performed elsewhere in NIMH,. 

In the National Center for Educational Communication, pressure 
toward relevancy and utility of R&D Is encouraged through 
proposal negotiation and in the development of new program 
areas but this influence does not extend to the bulk of the U.S.O.E, 
R&D effort. The application of R&D in the area of D&U is one of 
the five specified objectives of NCEC and staff have been very 
active in both producing and using research on D&U. 

COMPARl SON : All four units have made some impact on the relevancy of 

research through the guidelines, suggestions, etc. added to 
research proposal requirements; a somewhat greater impact on 
di ssemi nab i 1 i ty of research has resulted from requirements for 
final reports. There has been inore success closer to home 
(i.e., in the R&D funded by the units), and only in the 
recent past have the units begun to have tlieir guidelines 
imposed on all of the research sponsored by their agencies. 

O 

ERIC 



MA: 



SRS: 



OE: 



11 



Function Set Ifk. Sol ut i on Process I ng 

MAXIMAL ; /loximaj DSU activities in the area of solution processing 
would Include steps designed to move a valid solution 
idea Into Implementation fn a user system. Such functions 
as i:ransformIng knowledge into usable forms, transmitting 
knowledge to appropriate audiences, and helping people to 
use knowledge would be subsumed under solution processing. 

The Division of RsD UtiM7.ation Is probably strongest in 
the area of knowledge t rans forr.iat lone ; packaging, tailoring, 
and targettlng RsD findings to specific auidences is a 
primary concern as Is screening for quality materials. Al- 
though the Division maintains an In -house, manual system 
of storage and dissemination which generally ana>/s them 
to provide documents at any time, this system operates 
exclusively for those products that have come out of its 
own RSD program and tends to be used most extensively by 
university R^D persons rather than practitioners or adminis- 
trators. The Division does not have the resources to be a 
'^user helper" beyond individual, informal cases. 

SRS ; Knowledge transformations conducted by the Research Utiliza* 

tion Branch include such products as the Rg>D Brief Series , 
two-page summaries of selected projects that spell out 
Implications for users; tailoring to specific audiences 
seems to be a major Branch concern. Transmission activities 
are not as well delineated as are transformation activities; 
however, RUB is In the process of developing an SRS-wide 
Information system, and has developed a guide on how to use 
other existing information systems^. In terms of user helping, 
RUB acts as a linker to the various attempts at this function 
as performed by other units within SRS. 



NiMH ; Although the Mental Health Services Development Branch has 

not concentrated Its efforts in the area of knowledge trans- 
formation, two new magazines, I nnovat i ons and Evaluat ion , 
have been designed as transformation devices. In terms of 
transmission activities. Branch efforts are handicapped some- 
what by the decentralized nature of NIMH; however, staff 
members employ both formal and informal means to insure that 
knowledge reaches relevant audiences. Manuals, field con- 
sultation visits, and training projects are designed as user 
helping mechanisms by the Branch. 

OE ; Within the National Center for Educational Communication, the 

Educa t iona 1 Resou roe I nforma t ion Cen t er (ERIC) car r i es the 
bulk of transformation activities for the O&U unit. in many 
respects, ERIC is a model system equipped to do all of the 
print-based archival , integrative, and transformation functions 
necessary to give users complete access to the storehouse 
of knowledge In a major social problem area. Although trans- 
mission activities are not as strong as transformation activi- 
ties in NCEC , there is a t rend toward i ncreas i ng the rea Im 

O 
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of these functions. NCEC employs vnrfous means to help \ 
users Implement Innovations based on R&O; for example, a 
system of extension agents will be expected to provide 
developmental assistance to local educational practitioners 
as part of the 1 r role . 

COMPARISON ; Three of the four agencies, HA, SRS, and OE, are strong 

In the area of knowledge transformations. None of the four 
D6U units are as heavily Involved In transmission activities. 
SRS, NIMH and OE provide some user helping functions In terms 
of consultants and linking agents. 



Function Set yf^S- Microsystem Bui Iding 



MAXIMAL 



MA: 



SRSi 



NIMH: 



OE: 



Microsystem building refers to activities In which many 
elements of the problem-solving dialogue are simultaneously 
present and are allowed to Interact on a small scale. 
Maximal D£U functions In this area would Include Intel'- 
changes between researchers or developers and users, user- 
collaborative R6D| and Integrated ROD&U programs. 

In the Division of RfiO Utilization, emphasis Is placed on 
Interchange situations, although these now occur on an 
Informal basis. User-collaborative RSD also is stressed 
tn the Division: In the model of ^'projects as dissemina- 
tors,'^ user Involvement Is encouraged In the early stages 
of projects. A good example of Integrated ROD&U programs 
supported by the Division would be the Experimental Manpower 
Laboratories set up In priori ty areas of needs. 

The Research Utilization Branch Is beginning to experiment 
with the use of researchers "on-demand and on-calP'j other 
such interchange situations are also promoted by RUB as are 
vuser-collaborative R5D projects. Examples of integrated 
RDO&U programs Include that of the Public Assistance tn 
Vocational Rehabilitation program and various activities of 
the Research Utilization Laboratory In the Jewish Vocational 
Servl ce. 

Of the three functions subsumed under microsystem building, 
the Mental Health Services Development Branch appears to 
be strongest in the area of integrated R0D6U programs. The 
most salient example of such programs would be Branch efforts 
directed toward the children's area priority. The Branch has 
also sponsored some user-col laborative R£p projects, and 
although Interchange activities have been encouraged , 1 1ml ted 
funds have prevented the Branch from being able to develop 
the full potential of these 1 nterchange s t tua t I ons . 

The National Center for Educational Communication appears to 
have had little direct Involvement in microsystem building 
between researchers and practitioners throughout the educ-i- 
tlonal establishment/ However, Increasing attention Is 
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being paid to the role of NCEC In this regard, and efforts 
toward building user-coHaborat I ve R6D and Integrated RDD6U 
programs are being recognized as necessary prerequisites to 
user Installation of R6D products. 

COMPARI SON : Tor microsystem building^ system complexity appears negative- 
ly related to the proportion of effort expended In Interchange 
and combined R6D and RDD£U projects, OE, in particular, had 
fewer such activities, although It Is moving In that direction. 
The other three agencies, especially HA and NIMH have engaged 
in diverse activities Involving these functions. 



Function Set #6. Macrosystem Building 



MAX i MAL : 



MA: 



SRS: 



Although most macrosystem building functions lie outside 
the domain of any particular unit v/ithin an agency, several 
processes can be identified as maximal DSU activities In 
this area: modelling of the macrosystem, monitoring of the 
macrosystem, promoting linkage, filling recognized gaps, and 
building system awareness. 

The Division of RSD Utilization stresses the development of 
Informal linkages within the Manpower Administration; one 
method used for this purpose Is the "buddy system." Linkage 
between macrosystems is also emphasized. These linkages are 
helpful In terms of building awareness of the utilization 
system and in macrosystem modelling. Utilization laboratories 
have heeo supported where research, dissemination, and research 
on utilization can go on simultaneously with longer-term 
planning and funding. 

The Research Utilization Branch has been working toward the 
development of an SRS-wlde utilization system; however, lack 
of a common perception of the system has been a problem. 
RUB has stressed the importance of building networks and has 
served as a catalyst in many SRS efforts, e,g., research 
utilization specialists as linkers to the states. No unit In 
SRS has responsibility for building System awareness, al- 
though it appears that the new management procedures may be 
directed at this function. 



MIMHj 



OEi 



The Mental Health Services Development Branch Is not In a 
position to engage In macrosystem building for NIMH; al- 
though there have been some efforts by NIMH as a whole to 
do this, past efforts have not been In tiie area of O^U. 
However , Branch members are participating in a newly- formed 
Study Group that is concerned wi th the problems of linkage 
and D6U In th0 NIMH system. 

The Nat ional Center for Educational Communication has done a 
great deal of gap f I 1 1 Ing and InstI tut ion bul Iding. The 
network of sped all zed 1 Irtki hg agents based instate agencies 
and the nineteen subject area clear inghouses wl tli I n the ERIC 
system are examples of macrosystem bul iding act I vi ties . |n 
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terms of system mapping, a study of the educational 
Information need sensing network has been funded as 
has another national survey of Innovation process 
and information use In school districts. 

COMPARJ^ON: There Is quite a bit of variation in DSU unit activity 
In the area of macrosystem building. SRS and NIMH 
have been less active, comparatively, but for different 
reasons: In SRS the difficulty has been the lack of an 
integrated system to be modelled; in NIMH It Is perhaps 
the difference In approach between the D&U unit and the 
majority of NIMH subsystems which Is the cause. 

As an overview, the model has proved to be a great help In categorizing 
D&U activities of the four agencies. Each step shows relevant diversities 
anx>ng them, and In addition, highlights areas where there has been limited 
act 1 vl ty in any agency. 

The scarcity of entries In two of the model steps In particular, need 
sensing and user helping, give testimony to the top-down, linear approaches 
to knowledge utilization which have been popular, at least In the past. In 
many agencies. Some agencies are, however, working their way through the 
model activities In reverse order In their attempts to Increase utilization: 
O&U began as a dissemination arm, then became Involved In translation activi- 
ties and, ultimately, attempts to Influence the relevance of R&O projects. If 
this trend continues, we would expect maturing OSU units to make more and more 
effort to generate or link to need sensing efforts, and to couple the results 
with their R&D relevance-building. User helping appears limited by client 
group size given the smallness of Washington-based D&U units and their remote- 
ness from practitioners in the field. With the push toward decentralization, 
however, the units may become involved in wider agency efforts to provide train 
Ing help to regional or state staff geared to direct user helping. 

Thus, the model has proved useful for us In this study. The question 
remains, however, as to the utility of the concepts In each of the model steps 
for other studies in different sy$toms. Let us turn to what we have learned 
In the first attempt to generalize and test the model . 

TESTING THE MODEL-THE RESOURCE SCIENTIST STUDY 

For the past three years Morris and Ltngwood (e.g., 1973) have been In- 
volved In an action-research project with a major Federal natural resource 
agency. The project' us#§ a guiding model of organizational problem solving in 
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R6D organizations, which sets up a problem-solving sequence for each of four 
major topic areas: organizational long range planning, organizational factors 
common In *'0D"* research, individual scientist factors (of background, moti- 
vation, team and organizational fit, satisfaction, and productivity), and 
finally, D6U Itself • Our approach has been that of locating those creas this 
applied R&O organization sees as creating the most difficulties, then moving 
through problem solving to help the system Improve Its performance. 

Although we cannot give complete detail of this work here, it is suf- 
ficient for our purposes to indicate that research ut i I izatlon^-actuaUy get- 
ting research products put to use "on the ground*' with resource managers-- 
proved to be the area of major concern In the organization. Thus the project 
is In the Interesting position of conducting research on OSU In the organiza- 
tion, then (In the action component) disseminating our findings to the organi- 
zation and helping them put It to use, and finally evaluating our own utiliza- 
tion steps. Needless to say, the OSU nx>del we have been discussing is thus 
both an object of our study, and a mirror by which we can see our own activi- 
ties. 

The major data collection activities of the project have centered around 
a sel f-adml nl stered mailed questionnaire sent to a census of scientists, 
team leaders, and administrators (plus a 1/3 sample of technicians 

).3 The 

Instrument was developed with heavy dependence on prior research on organiza- 
tlonsi scientists, and DSU, and also drew heavily on the results of a full 
year of problem formulation interviewing we conducted throughout the system. 
In the area of DSU we were interested both In the applied and scientific out- 
put of the individual, and in those organizational and Individual factors 
which should predict output. The DSU model was adapted to provide ratings of 
scientists" evaluations of present and Ideal D&U activities within their 
research station. These ratings of activities, as filtered through the model» 
will be the focus of our concern for the rest of this paper. 

There are two sets of questions involved: first, how do Indices of the 
model steps (both ideal and actual) relate to other Indices of the organiza- 
tion's and Individual's 06U-related behaviors; and second^ how well can the . 
model-derived ratings 6f O&U predict scientists' scientific ajid appl led contri- 
bution In their field and cl lent groups . We developed a set of Items from all 
of the model steps except macrosys tern building (wh Ich we fel t was too remote 
an activity to be particularly relevant to sclent Ists) • Solution bu( Idfng 
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Items focussed on the concept of doing client-centered research.^ Below we 
will relate the model-step Indices to other D5U indices, and then to contri- 
bution, controlling for other relevant individual and organizational varia- 
bles. 

(1) The Relation of the DsU Model to Other DSU-Related Measures 
Since the appl Icat 1 on of knowledge Is such a pressing concern within 
the organization,^ we developed several different sets of measures to cover 
the area, beyond the model indices themselves. Particularly relevant ques- 
tions covered: 

1. the importance of user problems to scientists, 

2, the opportunity they feel they have to work on those problems, 
3* the extent to which scientists are stimulated by users and their 

probl ems , and 

the degree to which they feel their immediate organizational con- 
text supports OSU and client helping In general, and their own 
utilization activities in particular. 

We would like to know how well the D6U model Indices relate to these factors, 

controlling for personal and job-related differences of scientists and team 

leaders. Table 1 conta Ins the answer. 

The meaning of the 06U model indices needs some clarification here. For 

example, the "actual" "User Problem Solving and Helping" Index (the top line 

in T able 1) indicates the extent to which the respondent thinks scientists In 

his research station are engaged In these activities now, and the "Ideal" 

Index measures the extent he thinks they should be involved in such activities. 
The partial correlations here Indicate that those who think the OsU model 

steps are more important, as an ideal, also indicate they get more stimulation 
from their clients, and think user problems are more Important. The correla- 
tions for the "Actual" D&U steps (as they are now) are much more modest. Per- 
haps there are constraints in the organization and/or the reward system which 
limit the ability of scientists to respond to client needs, thus attenuating 
the "Actual" measures' power to relate to client stimuli and client problem 
Importance* The Ideal measures may be free of such constraints. 

Conversely , those who rate actual D&U higher now are those who have 
greater present opportunity to work on user problems. Again, the Ideal -actual 
differenced show up across all of the model indices* If we took at the two 
Indices of Importance of and opportunity to work on user problems , we see the 
kind of convergence we would hope to find: ratings of actual D6U, In model 
terms, correlate best with opportunity, while ratings of Ideal DsU correlate 
best with importance of user problems. 
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Finally (in the last column of Table 1 ) , we see that the scientists* 
perceptions of the degree to which their organization supports OSU and their 
efforts In this direction correlates reasonably well with ratings of actual 
DsU In the five model areas. Again, the actual ratings correlate better with 
the Index of organizational OsU than do the Ideal model Indices, 

Thus, we have found that Indices representing the inodel do correlate to 
a moderate degree with other measures of DSU, and that there Is a convergence 
between model ^MdeaP' perceptions and (at least one) separate measure of 
Ideals (the Importance of user problems), and between ratings of actual DSU 
and other measures of present OsU conditions In the organization* On this level, 
at least, the model seems to *'work'* as we would hope. 

We have not discussed differences across the model steps. There are 
minor differences In the correlations In each of the columns of Table 1 which 
are explainable. For example, actual microsystem building Is the best of the 
actual^ model measures In terms of correlation with stimulus from clients. Our 
Intej:vlewlng has found that Informal, direct Interchange between scientist 
and client Is the most frequent way linkage Is accomplished, when it Is done 
at all. If this is so, stimulation from clients should come primarily through 
this mechanism, and the *^actual" model correlations seem to bear this out. 
Overall, however, the model Indices seem to operate very similarly, In their 
Ideal and actual sets. In terms of their correlations to other 06U measures. 
We know, also, that there are very high correlations among the model -derived 
Indices. It Is difficult to say whether the indices are poorly conceptualized 
and incapable of controlling distinct variation, or whether it Is simply the 
fact that persons who see ideal or actual O&U as high or low in one rfiodel step 
also see other steps the same way* 

(2) The Relation of the DsU Model to Scientific and Applied Contribution 
The next question is the extent to which the model steps relate to the 
contribution of the individual to his field and to applications. We have 
developed two parallel measures for scientific and applied contribution which 
win be used here, and which are major criterion measures In our work. These 
measures combine appropriate written outputs, events attended, and perceptions 
of contrlbt'tlon of past and present work.7 We would hope that the O&U Indices 
cbrrelate better with the applied contrlbut Ion measure than with sclent 1 f(c con- 
tribution* 0 
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Before we can have any degree of confidence In the correlations, how- 
ever, we must control for personal and job-related characteristics which 
are known to relate to both the OfiU Indices and to contribution. Also, 
there Is a .50 correlation between applied and scientific contribution, so ■ 
we will need to "purify*' each contribution measure by controlling for the 
other. The correlations are given In Table 2. 

Let us look at the OSU Index relations with scientific contrtublon 
first, even though we had no specific predictions for these correlations. 
We find that those scientists and team leaders who are higher In scientific 
contribution say actual need sensing Is done better in their stations, but 
they are lower in terms of the extent to which they think doing client- 
centered solutfon budding Is an important Ideal. These findings may be 
clarified somewhat: there was no exact definition of who "clients** are, at 
least within the DSU rrodel Items themselves. High scientific contributors 
may well be thinking of other researchers as their primary client groups 
for the need-sensing Items. The Client-Centered Solution Building Items 
were, however, more cl ose ly sped fled as referring to "on the ground" land 
manager cl lents . 

Different results occur for the relations of the DSU Indices with the 
man's applied contribution. Independent of personal and Job factors, and 
of scientific contribution, those respondents who are making greater levels 
of contribution to applications rate their stations higher, and consider the 
Ideal activity as higher In the areas of need sensing, doing client-centered 
research, and microsystem building, in addition, applied contribution is 
greater among those who think translation and transmission are more Impor- 
tant In the (deal, although there Is no relation for current stations actlvl 
ties in this area. * 

Thus, all of the D&U index areas except user problem solving and help- 
ing appear to have some modest independent relationships to the scientist's 
applied contribution* The lack of relation for problem solving might be 
organization-specific In that the agency has not stressed d 1 rect help for 
c! lents beyond microsystem activities such as workshops, consultfngi etc., 
and much reliance Is placed on "how to do I t" publ icat 1 ons . 

None of these correlations are large, especially compared to organiza- 
tional and Individual predictors of contribution. We should expect to find 
Sdmewhat greater correl^ for "ideal" ratings if there Is a strong rela- 
tionship between Attitudes and action, since Individual behaviors In each of 
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the five Index areas wpuld be defined as exactly what we mean by applied 
contribution. The rather abstract question wording (couched In terms of 
what the station's researchers actually do and should do) might account 
for some of this slippage. Nevertheless, we need to do additional work to 
determine the adequacy of the model as a whole for describing researcher- 
cllent linkages, and we need more careful operat lonal Izat ion of model- 
related items when we choose to work at the attltudlnal level, 



CONCLUSION 

We have traced the development and field testing of a generic problem-- 
solving D^U linkage model. We have shown the richness the model Is capable 
of capturing In describing D&U activities on the non-quant I tat Ive level, and 
have found some, tf a more limited, use for the model concepts when they are 
translated to attltudfnal measures f or se 1 f-assessment by researchers. 
Clearly other studies are needed In both areas. We also need to test one 
additional application of the modelj^ that Is, Its unders tandab i 1 1 ty to client 
groups themselves as we seek to get our own knowledge put to use* 

Our experiences tn the four-agency D^U study showed that agency staff 
could understand the model, and adopt its terminology Into their own thinking. 
As with any model, however, we. did find some Individual resistance to any 
attempts to abstract Into categories what people do on a day-to-day basis. In 
the natural resource research agency study the results are not yet In, but 
we will be returning to the various research locations to feed data back and 
to help both researchers and managers understand the complex Issues of research 
utilization. Beyond this, however, we have begun to see some use of the model 
in that "cHent^' system which is perhaps the most difficult to influence of 
all: social scientists themselves. That Is we have begun to see our own O&U 
activities In model terms. 



FOOTMOTES 



1. The four units were: (a) The Division of ReD Utilization, Manpower 
Administration, Dept. of Labor, the sponsor of our project, (b) The 
National Center for Educational Communication, Office of Education, DHEW. 
(c) The Research Utilization Branch, Social and Rehabilitation Service, 
DHEW, (d) The Merftal Health Services Development Branch, National Insti- 
tute of Mental Health, DHEW, 

2. The editorial 'V/e'^ here masks the fact that the model was the pro- 
duct of long hours on the part of Ronald G. Havelock, The rest of the 
project staff (LIngwood, Ms* J. Freund, and Ms. B. Ramirez) helped In 
the refinement and polishing of the model, Ms. Ramirez prepared the sum^ 
mary comparisons of the four O&U units which we^wlll present later in the 
paper. 

3* The overall response rate for the survey approached 9^ percent. 

^. Respondents answered each of the following Items twice, first for the 
extent to which researchers In their station did these activities now, and 
once for the extent they should be doing these activities. The Items were: 
User Problem-Solving S Helping: 

*^Helping user groups develop a capacity to solve their own 
problems.*' 

"Finding someone In each user group to help In dissemination 
and Implementat 1 on 
Need Sensing: 

'^Developing and using regular mechanisms for determining what 
users^ needs are.'* 

"Transforming users' needs into problem statements and research- 
able questions." 
Client-Centered Solution Building: 

"Doing research which Is directly applicable 'on the ground'." 

"Doing work on problems at the time they are most Important- to 
users ." 

Translation and Transmission (Dissemination): 

"Producing summaries, abstracts, and reviews of research find- 
ings." 

"Rewriting research products In the language of each important 
user group. 

"Determining who the Important users should be for each finding 

to be transmitted." 
"Selecting the most appropriate channels to be used to reach 
each user most efficiently." 
Micro-System Building: 

"Designing ways to get users and researchers working together 

on Joint projects." 
"Organ I z ing ways users and researchers can get together to 
exchange information . " 
The grouping of I terns into ! hdt ces was accompl 1 shed through Joint us6 of con- 
ceptual i terir pi acement <fiind empirical factor and cluster analyses. 
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5. We can underscore the verbal concern of top levels of the organization 
with 'the findings that assistant directors of the research stations were 
consistently higher than team leaders^ who In turn usually scored higher 
than scientists, on most of the Items relating to the Importance of 



6, These ladJces were composed 3f the following Items: 

StlmuJl from Clients: (extent stimulated to perform well by) 

"Problems arising In practical appl Icatlons 

"[tntra-organtzatlonal land manager] user groups.** 

"User groups outside of the [agency]." 
Importance of User Problems (importance would attach to each of 
these factors of the Job): 

"To work on problems of central Importance to the station." 

"To work on problems of central Importance to the station's 
user groups," 

Opportunity to Work on User Problems: ratings of the Items above In 
terms of how much opportunity the man's job provides to do each. 

Organizational DSU: (agreement with the following, as opposed to 
their polar opposltes) 

"My location makes contact with the rest of the station very 
easy," 

"There Is persistent and strong pressure from outside my unit 
to ensure that Its results find follow-up or practical ap- 
pl Icatlon," N 

"Unit staff often serve as consultants with user groups regard- 
ing applications of our work," 

"[the agency's] leadership encourages and roWafds me for get- 
ting 'on the ground' applications of my research," 

7. The Scientific Contribution Index weights equally contribution In each 
of the three areas below: I 

Scientific Output; books and book chapters, abstracts and reviews, 
articles in journals, scientific station publications, and 
meeting papers or presentations (number In past five years), 
Sclentif c Events: regional or national, and Internationa! meet- 
ings or symposia, workshops and seminars, which were scientific 
or technical In nature (measured over the past two years)* 
Scientific Contribution Attitudes: Agreement with the statements, 
"My present work Is likely to make a very substantial contribu- 
tion to Scientific or technical knowledge in my field," and, 
"My unit haa made an outstanding contribution to scientific or 
technical development In Its field," 
Applied Contribution equally weights these three areas: 

Applied Output: popularized articles, "how to do It" station 

publ I cat Ions (number In past five years). 
Applied Events: number of researcher-user workshops and 
seminars , pub) Ic meet ings and hearings, user Interest 
group meet irigs, and planning meet Ings In pubj ic_or private 
Sector (number In past two years), ^ ^ ■ 

Applied Contribution Attitudes: Agreement with the statements, 
"My present work Is Ijkely to make a very substantial coh- 
tributlon to practical appl Icat Ion or use *on the ground,'" 
and, "All of my unit's research results find follow-up or 
practical appl tcation." 
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Table ] 

Partial Correlations Between 06U Attitudes 
and Other DSU-Relevant Indices^'* 

(Data from 707 natural resource scientists and team leaders.) 

Other D&U-Relevant Indices: ^ 

StlmuU from Importance Opportunity Organl- 
Clients of User to Work on zational sup 

Problems User Problems port for O&U 



06U Model Indices: 












User Problem- 
Solvlng/Helplng 


Actual 
Ideal 


.08^ 
.15^ 


.09? 

.2]° 


.io'» 


.20^ 
.07a 


Need 
Sensing 


Actual 
Ideal 


.093 
.22b 


.!8b 


.27b 
.05 


.31b 
.02 


CI lent-Centered 
Solution Bldg. 


Actua 1 
Ideal 


.lib 
.31b 


.08f 
.30^ 


.21b 

.10^ 


.29b 
.089 


Solution proces- 
sing Channels 


Actual 
Ideal 


.03 
.J7b 


.06 
.20b 


.19^ 
.lob 


.22b 
.lib 


Microsystem 
Bui Id I ng 


Actual 
Ideal 


.26b 


.2?'' 


.27^ 
.lob 


.37^ 

.12b 



a = p ^ .05; b « p .0! 

These correlations are partial led on the following variables: 
--level of education 

--years experience In the research organization 
--hours worked per week 
--job title (scientist vs^. team leader) 
--G.S. Grade 



Table 2 



Partial Correlations Between O&U Model Indices 
and Scientific and Applied Contribution 

(Data from 727 natural resource scientists and team leaders.) 



Scientific 
Contribution 



Appl led 
Contribution 



O&U Model Indices: 








User Problem 
Solving/Helping 


Actual 
Ideal 


.07 
.03 


.07 
.05 


Need 
Sensing 


Actual 
Ideal 


.12'^ 
-.03 


.083 
.10^ 


CI lent-Centered 
Solution Bui Idtng 


Actual 
Ideal 


-.11'' 


.lOb 
.22'' 


Solution Processing 
Channels 


Actual 
ideal 


.08^ 
.06 


.03 
.13^ 


Microsystem 
Building 


Actual 
Ideal 


.09^ 
.02 


.13^ 
.17'' 



= P 4 .05; b « p 4 .01 



* These correlations are partialled on the following variables: 
--level of education 

--years experience In the research organization 

--hours worked per week 

—Job title (scientist ys_. team leader) 

"-G.S. Grade , , , 

In addition, correlations Involving Scientific Contribution are a so 
partialled on Applied Contribution, and conversely, correlations in- 
volving the Applied Contribution are partialled on Scientific Contri- 
bution. 



